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Description 

This invention relates to an image viewing station for picture archiving and communications systems 
(PACS), and more particularly to such a station for processing and displaying digital diagnostic images. 

s In recent times, escalating hearth care costs have spurred efforts to make health care delivery systems 

less expensive and more efficient, particularly in hospitals. This has led to the introduction of computers in 
many areas of hospital management. Computers have been used for many years in areas such as patient 
registration and in clinical laboratories. A major new application area is within radiology departments. 

Modern radiology systems will consist of two major components. The first component consists of a 

jo system to provide management tools such as scheduling and inventory control. The second component is a 
system to replace the film based imaging systems currently used in radiology departments with their 
photoelectronic equivalents. This application area is called PACS (Picture Archiving and Communication 
Systems). 

A PACS system can be divided into several subsystems as shown in FIGURE 1.0. They are 
is photoelectronic image acquisition 2, image storing or archiving 4, electronic image transmission 6, image 
display 8, and external communication links 9. The specification of each of these components is a function 
of the number of images generated, the resolution of these image, and the number of times each image is 
viewed. 

Chest radiographs comprise about 85% of the total case load in a radiology department. They are also 
20 the most difficult class of images to handle. These images are characterized by a spatial resolution of at 
least 2048 x 2048 pixels with a 60 db dynamic range. Thus, each chest radiograph requires about 40 
megabits for representation. To transmit such an image from an archive to a display workstation in 0.5 
seconds (time requirements to be discussed below) requires a transmission bandwidth of more than 80 
megabits/sec. To display such an image on a video monitor (with a single gun CRT) requires that data be 
25 presented at an 2.8 megapixel rate. These requirements underscore the difficulty in processing a chest 
radiograph within a PACS environment. Since a large percentage of a radiology department's work load 
involves the generation and diagnostic evaluation of chest radiographs, a successful PACS system 
obviously must be able to accommodate the vast amounts of image data forthcoming from the chest 
radiographs. 

30 The first of the PACS subsystems is the photoelectronic image acquisition system 2. Many medical 
imaging modalities already produce images in digital form. These include Computed Tomography (CT), 
Nuclear Medicine, Magnetic Resonance Imaging (MRI), Ultrasound and Digital Subtraction Angiography. 
These images are characterized by spatial resolution 512 x 512 or less, with 40 to 60 db dynamic range. 
Until recently there was no photoelectronic system capable of acquiring large format (14 x 17 inch) images 

35 such as those of the chest. Without this large format capability, a PACS system would be of little value 
since these images comprise such a large percentage of all those taken. The introduction of large format 
image acquisition systems eliminates the last major PACS specific data acquisition problem. 

The second PACS subsystem is image archiving 4. There are many approaches to this problem. The 
current strategy is to divide the archive into two sections. The first, a short term archive, is designed to 

40 handle the active images for patients currently under treatment. It is characterized by rapid access time, 
read/write capability, and limited storage. The long term archive is non-erasable. Laser optical disks are 
being proposed for this application. The current technology will provide approximately three gigabytes of 
storage on a ten inch diameter disk. The combination of these two technologies will provide for both rapid 
access to active images and compact long term storage. 

45 The third PACS subsystem is image transmission 6. The transmission system must provide bidirec- 

tional communication between acquisition systems, display workstations, and the image archive. It is 
envisioned that this system will eventually become a component of a national network 9 linking together 
hospitals all across the country. The primary design considerations for the image transmission system are 
speed and reliability. Speed is being achieved through the use of parallel fiber optic transmission links. 

50 Reliability is achieved through redundant data paths. The systems are designed such that a single cable 
failure will have only local effect. 

The fourth PACS subsystem and the subject of this invention, is the digital image viewing workstation 8. 
This workstation will functionally replace the large panels of light boxes currently used with the film based 
imaging system. 

55 Radiologists consume information at an incredibly large rate. In a typical situation, six to eight images 

will be examined and the report dictated in less than a minute. To meet the needs of the PACS system, and 
to be accepted by the medical community, the viewing workstation must provide image handling no slower 
than that of the film system it is designated to replace. 
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From GB-A-2 078 411 the general construction of an image viewing system is known. EP-A-01 83201 
and EP-A-01 82237 disclose methods and means for obtaining interim values by polynomial interpolation. 
These values are required for "zooming" a stored digital image. 

Accordingly, an object of this invention is to provide a new and improved image viewing station for use 
s in the PACS environment which has a multimodality display capability and thus is capable of displaying 
images of different image modalities providing different spatial resolution and dynamic range on the same 
screen for comparison purposes. 

The object is achieved by the features set out in claim 1 . 

Another object of this invention is to provide a novel viewing station in which image data of different 
jo imaging modalities are independently processed and displayed on the same screen. 

Another object of this invention is to provide a viewing station as above noted, having multiple high 
resolution displays. 

Yet a further object of this invention is to provide a novel image viewing station capable of performing 
independent image processing of multimodality image data, including processing functions that mimic 

)5 manual operations currently performed in the conventional film-based system, including an electronic zoom 
capability to provide the same function as moving film close to the eye for close inspection, and contrast 
enhancement performs the same function as "bright lighting" a film. 

A further object of this invention is to provide an image processing capability for an image viewing 
station which will allow a radiologist to visualize information that is presently not appreciated and will 

20 thereby provide a diagnostic enhancement over the film-based system. ^ 

Yet another object of this invention is to provide an imaging viewing station for a PACS system which is 
fully user friendly and which is usable by a physician with only a minimum familiarity of the viewing station. 

Yet another object of this invention is to provide in a PACS environment an image viewing station which 
would be used in the reading room of a radiology department, or in speciality clinics, such as cardiology, in 

25 which radiographic images play a major role in diagnosis. In this evnironment, a physician would log onto 
the system to view one or more of his patient's images. Possibly, the images to be viewed may have been 
previously sent from the archive to the viewing station by an operator on the archive system. The physician 
would use the viewing station to look through a directory and select his patient's images for display. The 
viewing station of the invention would then display the selected images in an initial state specified by the 

30 image parameters in the physician's adaptive interface file entry. If the physician would prefer all bone 
images white on a dark background, but angiograms black on a white background, the status of the images 
would be initialized so that they appear that way when first displayed. The station of the invention is 
capable of calling up several images, allowing some to be placed at a default position and permitting the 
direct specifying of the positions of others using touch screen controls. These touch screen controls can 

35 also be used by a physician to move an image across the display to bring it into juxtaposition with another 
image comparison. In so doing, the viewing station of the invention enables the physician to adjust the 
window/level settings to bring out contrast, perhaps using a high pass filter to sharpen edges. Further, the 
viewing station of the invention enables the physician, after examining a set of CT images, chest and 
nuclear medicine images, to call up a sequence of cine images as a movie loop, to view coronary arteries. 

40 On the other hand, if the user of the viewing station is not a radiologist, he could display the text of the 
report dictated by the doctor who read the images. The viewing station of the invention is sufficiently 
flexible such that the archive could be queried for further images which were previously sent. Once finished, 
the physician could erase the images from the display and move onto other patients or log off the system. 
According to the present invention a new and improved image viewing station is provided having an 

45 architecture including a base memory, image processor and display memory which permits multiple images 
to be displayed on a display monitor for immediate viewing by the user and which allows the processing of 
various locations of the image independently of the other locations thereof and for the display of the image 
to be instantly updated in response to the user's commands. According to the invention, the radiologist user 
sees the image as it is being interactively manipulated and processed by the system as commands are 

so entered via the user interface. 

A more complete appreciation of the invention and many of the attendant advantages thereof will be 
readily obtained as the same becomes better understood by reference to the following detailed description 
when considered in connection with the accompanying drawings, wherein: 
FIGURE 1.0 is a block diagram of a PACS system; 

55 FIGURE 1.1 is a schematic block diagram of the image viewing station according to the invention; 

FIGURE 2.1 is a flow chart illustrating the operation of the physician's review console memory request 
arbitrator used for servicing requests on a priority basis; 
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FIGURE 2.2 is a block diagram functionally illustrating image data loading into the base memory from 
the NIM port or by the VME bus port; 

FIGURE 2.2.1 is a detailed block diagram functionally illustrating the base memory; 

FIGURE 3.1 is a block diagram illustrating the base memory address generator provided in the image 
5 processor; 

FIGURE 3.2 is a block diagram functionally illustrating the subtractor of the image processor according to 
the invention; 

FIGURE 3.3 is an illustration of how fractional zoom bilinear interpolation is performed by the image 
processor according to the invention; 
w FIGURE 3.4 is a detailed block diagram illustrating the fractional zoom bilinear interpolation performed by 
the image processor according to the invention; 

FIGURE 3.5 is a schematic block diagram functionally illustrating the image processor; 

FIGURE 3.5.1 is a detailed block diagram illustrating the substractor, LUT and histogram component of 

the image processor; 

75 FIGURE 3.5.2 is a detailed block diagram illustrating the FIR filter of the image processor; 

FIGURE 3.5.3 is a detailed block diagram illustrating the line buffer in the image processor; 

FIGURE 3.5.4 is a detailed block diagram illustrating the continuous zoom (COZO) component of the 

image processor; 

FIGURE 3.5.5 is a detailed block diagram illustrating the display address generator component of the 
20 image processor; 

FIGURE 3.5.6 is a detailed block diagram of the image processors base memory address generator; 
FIGURE 4.1 is a schematic block diagram functionally illustrating the display memory of the invention; 
FIGURE 4.1.1 is a detailed block diagram functionally illustrating the display memory of the invention; 
FIGURE 4.1.2 is a detailed block diagram functionally illustrating the display memory controller of the 
25 invention; 

FIGURE 5.1 is a block diagram functionally illustrating the disk controller according to the invention; 
FIGURE 6.1 is a schematic block diagram of the user interface by which a user interfaces with the image 
viewing station of the invention; 

FIGURE 7.1 and 7.2 are illustrations comparing the functional operation of the image viewing system of 
30 the invention with the conventional viewing of film images by the radiologist, respectively; 
FIGURE 7.3 is a schematic diagram illustrating image state transitions; 

FIGURE 7.4 is a schematic diagram illustrating the structure of the disk according to the invention; 
FIGURE 7.5 is an illustration of the directory control track (OCT) which is the primary data structure on 
the disk; 

35 FIGURE 7.6 is a schematic illustration of the image location list (ILL) which is a structure within the DCT 
used to manage the tracks allocated to image data; 

FIGURE 7.7 and 7.8 are schematic illustrations of key descriptors and menu descriptors used according 
to the invention; 

FIGURE 7.9 is an illustration of the structure of the image parameter block (IPS) according to the 
40 invention; 

FIGURE 7.10 is an illustration of the image data lists and adaptive interface lists which maintain 
information about an image to be displayed; 

FIGURES 7.11 and 7.12 respectively illustrate an adaptive interface file which provides predetermined 
information for the initialization of an image parameter block and fault parameter values, respectively. 
45 which allows a user interface to be tailored for each user; 

FIGURE 7.13 is a summary of command vectors which distinguish the various types of inputs which are 
available to the image viewing station according to the invention; 

FIGURE 7.14 is a flow chart illustrating command processing of a direct command vector which enables 
use of the image viewing station even if a command monitor touch screen fails; 
50 FIGURES 7.15 and 7.16 are flow charts illustrating a command displatch routine and image activation 
and movement routines, respectively, according to the invention; and 

FIGURE 7.17 is a schematic block diagram illustrating the shuffle activation of images according to the 
invention; 

FIGURE 7.18 illustrates the management of base memory space: 
55 FIGURE 7.19 illustrates the relationship of the user interface with the overall system architecture. 

The primary justification for the development of an image workstation as described above is the 
requirement for a digital display station to replace currently existing film viewing technology in radiology 
departments. To be effective such a display station must be easy for the radiologist to use and must 
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provide diagnostic quality images. 

In terms of ease of use, the Hardware/Software architecture of this workstation provides the radiologist 
with a tool which is much easier to use. and to learn to use. than any previously existing digital device for 
use in digital radiology. This system provides a simple interface of self-explanatory command menus which 

s eliminate the necessity for typing by the user. Our previous experience developing digital intravenous 
angiography systems has taught us that radiologists do not like to type, since it slows down their work. The 
command input path in this system a "see and do" feedback path in which the system displays the 
commands available to the user and he may simply touch the one he wants to execute (Fig. 7.1). The 
touchscreen sensors send the location of his touch through the desk to the workstation (Fig. 7.19). The 

io workstation software determines which command menu key was touched by the user and invokes the 
software to perform that command (Figs. 7.14 & 7.15). The results of that command action will change 
either the image displays or the command display, or both, the alteration of information on the displays 
provides feedback to which the user may respond. Because of this command interface the user is not 
required to memorize commands. All the user needs to remember is the general action performed by a 

)5 command, not some cryptic command name or confusing sequence of operations to be typed in from the 
keyboard. This type of simplified interface is essential to the success of digital radiology. 

Another advantage of the architecture embodied in this system, and one which is also facilitated by the 
touchscreens is the manipulation of images directly by touch. This feature is not found in other currently 
existing digital workstations. When the workstation receives a toughscreen hit location on the image 

20 displays it determines which of the images currently appearing on the display was touched (Fig. 7.16). The 
software then selects that image to be the target of subsequent processing action by the user. This gives 
the user the capability of switching between images with very little effort. For instance, if the user has two 
images side by side on one display he may adjust the contrast and brightness of one image, touch the 
second and adjust its contrast and brightness, touch the first and adjust its magnifications and so on, until 

25 he has the two images appearing to his satisfaction. All of this is done without the need for keyboard input. 
The touch of an image selects it for processing and the adjustment of its contrast and brightness, or 
magnification, is accomplished by turning a knob on the desk. The only way he could do it with less 
physical work would be if he could use voice or thought activated commands. The latter is currently not 
possible and the former suffers from technical limitations (e.g., limited vocabulary, restrictions on pronoun- 

30 ciation, etc.). However, should those technologies become feasible the architecture of this sytem would 
allow their addition with very little difficulty. Of course, the user is not limited to two images for this kind of 
manipulation, and there is no requirement that an entire image be visible on the screen for it to be selected. 
As long as a part of the image is visible the user may touch that part to select the image for processing, 
while images which are completely covered by other images must be selected by the menu activated 

35 'shuffle* command (Fig. 7.16). The user is not limited in the number of images on the display and he is not 
required to remove images from the display in order to view subsequent images. Another aspect of the 
users direct interaction with images via the touchscreen is his ability to more images across the screen by 
"dragging" the image with his finger. This allows the user to juxtapose two images for comparison, or to 
move an image off to one side of the display, perhaps to prevent it from being covered by other images he 

40 may wish to view. 

Yet another factor which makes this system easy to use is the software management of the base 
memory and disk which relieves the user of the burden of managing base memory space. Systems 
commonly in use for display of digital images generally require the user to keep track of how many images 
are in the image memory. If that memory becomes full he must remove some image to make room for any 

45 new image data he wishes to view. The architecture of the workstation described in this document provides 
for the automation of this task in a manner similar to virtual memory management in general computer 
systems. The software determines whether an image will fit in the available base memory space and 
removes images if necessary. The images removed are those which have been selected for processing, by 
the user, least recently (Fig. 7.18). This frees the user from tedious image management tasks and makes 

50 the system easier to use. If the user should select an image which has been removed from the base 
memory it is simply brought back into memory, with another image removed to make room for it. Again, all 
of this takes place transparently to the user. These atures which contribute to the ease of system use are 
made possible by the speed with which images are processed by the system. The transparent management 
of the base memory is made possible by the 2.4 Megabyte/sec transfer rate between the disk and the 

55 display memory, and by the 150 nsec/pixel average processing speed of the image processor. If the user 
has several images appearing on the display and touches the exposed corner of one image which is 
overlapped by others, in approximately 275 second the system will determine which image he touched, 
process the image data from the base memory through the image processor and display the processed 
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image on the display monitor (Fig. 7.19). Of course, now the image will appear in its entirety, perhaps 
overlapping the images which previously covered it. If the selected image happened to have been removed 
from memory the response time will be slightly longer as the system determines another image to remove 
and then reads the selected image from disk into the base memory. When the user adjusts the contrast and 

5 brightness, or 200m or filter, the desk passes the change of the knob position on to the workstation. That 
change (or delta) is used to adjust an appropriate parameter {such as window or level, zoom factor or filter 
coefficients) and the image is reprocessed from the base memory through the image processor and the 
new processed image appears on the display. Because of the speed of the processor the system gives the 
appearance of being hardwired (like the contrast & brightness on a TV) and the software is transparent to 

w the user. With these features the system provides the capability for processing multiple, independent 
images quite easily, with much of the work accomplished simply by turning knobs on the desk console. In 
fact, there is no specific limitation on the type of image which may be processed by this system, though it 
was designed for digital radiology. Any black & white image, with 1 to 12 bits of contrast resolution, for 
which contrast/brightness, filtering and magnification/minification are meaningful could be successfully 

15 processed on this system. The images may be unsigned integer data or two's complement (i.e., signed 
integer) and may range in size from 4 to 4 million pixels. 

The capability of this system for displaying high (spatial) resolution images satisfies the requirements 
for diagnostic quality images. Current psychophysical studies indicate that a minimum spatial resolution of 
1024 x 1024 pixels is required for diagnostic quality images in chest radiology (85% of radiology is chest 
■20 imaging). The use of two 1024 x 1536 pixel monitors in this system meets those resolution requirements 
and provides an aspect ratio similar to that of the 14" x 17" film on which chest radiology is most 
commonly done. This provides an image display which is familiar to the radiologist and makes his transition 
from film based work to digital radiology much easier. Additionally, there is no limitation in the architecture 
of this system which prevents the use of more than two image display monitors. The 4 Megapixel base 

25 memory,, which delimites the largest single image which may be processed by the system, provides the 
capability for processing a 2048 x 2048 pixel image. Currently this is about the largest digital image found 
in radiology and there is some debate about whether any diagnostically useful information is gained by 
acquiring larger images (i.e., image of higher spatial resolution). Images of this size may be displayed by 
the system described in this document in a minified form in which the entire image appears on the 1024 x 

30 1536 display. This minification is accomplished by the image processors continuous (bilinearly interpo- 
lated) zoom which is referred to as COZO and which is the single most important, and unique, feature of 
this image workstation. This feature allows the user to view the entire image at less than full resolution and 
select the region of the image in which he is interested. That region may then be continuously zoomed, via 
the zoom knob on the desk console, until it is viewed at full resolution and the beyond and viewed 

35 magnified if desired. 

The Hardware/Software architecture of the image workstation described in this document provides a 
unique system with which a radiologist may conveniently, and quickly, view digital images. 

Referring now to the drawings, wherein like reference numerals designate identical or corresponding 
parts throughout the several views, and more particularly to FIGURE 1.1 thereof, a digital image viewing. 

40 station according to a preferred embodiment of the invention is there shown and includes a base memory 
10, image processor (IP) 12, display memories 14, disk drive 30 and an associated disk controller 32 for 
storage of images and data required for the operation of this system, and control processor (CPU) 16. The 
display memories 14 store processed image data and are connected to conventional cathode ray tube 
(CRT) devices 18 via a digital-to-analog converter (DAC), not shown. The viewing station further includes a 

45 network interface 24 which functions as an interface between the PACS, or other communication network. 
26 and an internal (VME) bus 28 connecting the interface 24 with the base memory 10. The internal 
address/data bus, VME bus 28, is provided for sequential memory data transfer and address transfer 
between all components constituting the viewing station. 

In the preferred embodiment of the base memory 10 has 4.2 Megapixels of dynamic random access 

so memory in which image data may be stored," with up to 12 bits per pixel. This provides capacity for images 
of up to 2048 x 2048 pixels, and the base memory 10 may hold multiple images simultaneously. Each pixel 
element in the memory 1 0 has an additional 4 bits reserved for graphics planes. These planes are used for 
performing graphic annotation and plotting which may overlay the image data. As may be seen in FIGURE 
1.1 and FIGURE 2.2, the base memory has three ports 110. 112, 118 that are connected to the IP 12. 

55 network interface 24, and VME bus 28. Through the network interface, a network request or data is 
transferred to or from the base memory 10 via the NIM port 110. The IP 12 reads image pixels from the 
base memory 1 0 through the image processor port 118. The VME bus port 112 with its associated control 
register 116 controls the configuration of base memory data words read from or written to the base memory 
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10 so as to allow individual graphics bits and/or image data to be accessed. The presence of the disk drive 
30 and controller 32 and its high speed connection to the base memory through the internal system bus 28 
provides an extension of the base memory to yield a virtual image memory of 1 70 Megapixels. 

The Workstations image processor 12 is composed of high speed pipelined array processors which 
s carry out the functions, of intensity (grey level) transformation on the entire image, histogram of regions of 
interest within an image, spatial filtering, and continuous bilinear interpolated zoom (hereinafter referred to 
as COZO). 

The display memories 14 each have two buffers capable of storing 1024 x 1536 pixels. At any one time 
one of the buffers is selected to provide the image currently being displayed. The display memories 

w implement a high speed architecture designed to refresh a 1024 x 1536 pixel matrix on the display at 40 
frames per second (to eliminate flicker). Additionally, the display memories have a replicative zoom (x 4) 
capability to allow the display of 256 x 256 pixel subimages in a 1024 x 1024 format, with any of the 24 
possible subimages selectable for viewing. 

In the preferred embodiment, the image data selected for procession passes first through the subtractor 

is 100, on to the look-up-table (LUT) 102 in which grey level transformation processing is performed. From the 
look-up-table (LUT) 100 the image data passes through the spatial (high/low pass) filter 104 and then into 
the COZO 106. The spatial filtering 104 may be adjusted by the user to vary between low pass filtering to 
high pass filtering, with no filtering of the image data at the midpoint between the two extremes. The COZO 
106 is designed to perform fractional zooms computed by bilinear interpolation and provides continuously 

20 variable enlargement or minification of the image to be viewed by the user. The operation and principle of 
COZO 106 is explained in detail below. 

As can be seen in FIGURE 1.1 the CPU 16 is provided with input equipment 34. The CPU 16 and its 
associated input equipment 34 may be any of a variety of well known devices capable of responding to 
input controls and developing corresponding signals for driving one or more sections of the review console 

25 in accordance with the preferred embodiment of the present invention, such as keyboard, trackball, 
function-keys, and function knobs. Coupled to the input equipment 34 are touch screens 35 which provide a 
particularly user friendly interface for controlling the display of images. 

BASE MEMORY 

30 

The role of the base memory 10 in the view station is to hold the raw image data and provide a high 
speed data path to both the image processor 1 2 and to the network interface 24. Base memory 1 0 includes 
a memory array 10' which can store the raw image data of many different imaging modalities simulta- 
neously up to a single 2048 x 2048 x 16 image. The triple ported base memory 10 can store variable length 

35 image data and assign a variable number of graphics bit planes on an image by image basis. To allow high 
speed memory transfers, the CPU 16 employs a fast memory request arbitrator 109 to sen/ice the requests 
on a priority basis, as shown in FIGURE 2.1. 

Referring to FIGURE 2.2, data is loaded into the base memory 10 from the NIM port 1 10 or by the VME 
Bus port 112. The base memory 10 provides 16 bit per pixel with a variable number of 8 to 12 bits for 

40 image data and the remaining 4 to 8 bit for independent graphics planes. When the data is loaded from the 
NIM port 100 or the VME Bus port 112, a respective read/write control register 114 or 116 governs which 
bits are image data and which bits are graphics bits and whether or not they can be written to. 

The NIM port 110 is an independent bi-directional high speed port which allows eight pixels to be 
written to or read from the base memory for a single memory request. The image and graphics bits 

45 involved during a write operation is governed by the NIM port's read/write control register 114. Such a 
design allows an existing image in memory 10 to have its graphics data updated without disturbing its 
image data. This scheme directly improves the efficiency of the PACS system by allowing only the required 
data needed for the update to be transmitted on the PACS network. 

The VME bus port 112 works similar to the NIM port 110 with the only restriction of being able to 

so read/write one or two pixels for a single memory request. However the VME bus port 112 has a unique 
enhancement in that during a read operation the data that is defined by read/write control register 116 as 
image data can be sign extended. Thus two's complement data can be further processed by the CPU 16. 

Base memory 10 also includes an image processor port 118 which is a high speed read only port that 
reads eight pixels for a single memory request. All sixteen bits of each pixel are transferred to a dual port 

55 Random Access Memory (RAM) 120 at the image processor port, as shown in FIGURE 2.21. The dual port 
RAM 120 allows simultaneous data transfer from the base memory 10 to the image processor 12 where the 
image and graphics bits are separated by the image processor 12 on an image by image basis. 



7 



w 



IS 



20 



25 



EP 0 258 976 B1 



The control registers 114 and 116 are 16-bit read/write registers mapped into the CPU's (MC 68000) I/O 
Page and are accessed through the VME bus 28. These registers provide enhanced bit masked read/write 
features for both the VME bus interface and the NIM interface. 

The VME control register, 116 has several functions. First of all it defines which graphics bits and/or 
image data will be involved during VME Bus read/write operations. Secondly it defines the size of the 
variable length image data word and thirdly it controls the readback format of the sign extended image data. 
Accordingly, the 16 bits (D 15 -Do) of the control register 116 are assigned as follows: 



D 15 °14 D 13 D 12 

< Graphis KAf > 
Control 

0 ■ Disable R/W 

1 - Enable R/W 



1111 

D ll °10 °9 °B 

< Only Defined > 
Graphics Bits 
H/W Control 



1 

1 1 

-111 
t 1 t 1 



°7 D 6 °5 °4 °3 °2 °1 D 0 



< Define > 
Image or 
Graphics 

0 ■ Image 

1 - Graphics 



Image Data Sign Extend >- 
Image Data ReaO/Write Control >- 



1 1 
f 1 
f 1 
1 1 
1 1 
1 f 
-1 1 
1 



Dis : D12 are graphics read/write control bits for the independent graphics planes. If any of the bits are set 
to a "1 " then a read operation from the VME Bus will readback that graphics bit. Likewise a write operation 
will only affect those bit planes whose control bits are set to a "1 ". If any of the four control bits are "0" 
30 then a read operation will readback a zero (0) in that bit position. Similarly a write operation will not affect 
those bit planes. 

Dn : Da are graphics read/write control bits only if the bit positions are defined as graphics bits by the 
nibble D?:Di. If any of the bits are defined as graphics bits, their read/write operation is similar to Dis:Di 2 . 
D? : D* define which bits in Di i :Ds are graphics bits and which bits are associated with the image data 

35 word. D7 defines bit Di 1 , similarly Dc defines D10 and so on. Any bits in C^D* which are set to a "1" will 
define that corresponding bit in D n :D 8 as a graphics bit, likewise any bits set to a "0" will define its 
corresponding bit as an image bit. It is important to note that bits which define the data as part of the image 
data word must be contiguous and start as D*. For example an 8 bit image data word would not have any 
of the bits in D7:D* set to a "0". This now leaves an extra four bits, Di i:Da, as graphics bits making a total 

40 of 8 graphics bits, Dis:Ds, available with independent read/write control. A 10 bit image data word would 
have the bit pattern "1100" in D^D? which defines data bits Da and D9 as image data bits with Di 1 and Dio 
defined as graphics bits and are available as graphics bit if needed. 



BIT PATTERNS 


IMAGE AND GRAPHICS # of Graphic Bits 


DATA FORMAT # of Image Bits 


D7 




D5 


D* 


1 


1 


1 


1 


8, 


Ds : Dis 


8, 


Do : D? 


1 


1 


1 


0 


7. 


Dg : D15 


9. 


Do : Da 


1 


1 


0 


0 


6, 


Dio : Dis 


10, 


Do : Ds 


1 


0 


0 


0 


5, 


Dn : D15 


11. 


D 0 : Dio 


0 


0 


0 


0 


4, 


Di 2 : D, 5 


12, 


Do : Di 1 



45 



50 



D3 : D2 are not used 

55 Di is used to sign extend the image data word during a VME Bus read operation only. If the bit is a zero 
("0") the image and graphics data are read as a complete 16 bit data word. If the sign extend bit is set to a 
"1 " and D 0 , the image read/write control bit, is set to a "1" then the variable length image data word will be 
sign extended to 1 6 bits. To sign extend the variable length image data correctly the bit in the D7 :D* nibble 
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must accurately define the length of the image data word. As an example assume that CVD* has the bit 
pattern "001 1" which defines a 10 bit image data word. If Di and Do are set to a "1" and a VME Bus read 
operation takes place the 10 bit image data word will be sign extended to 16 bits and place on the VME 
DATA Bus. Note that the sign extend function will ignore the graphics data. Also there is no sign extend 

5 write function for a VME Bus write operation. 

Do controls the VME Bus' read/write operation on the variable length image data. If Do is set to a zero ("0") 
and a VME Bus read operation takes place the variable length image data word will be readback as all 
zeros ("0"). Likewise a VME Bus write operation will inhibit any variable length image data being written to 
the Base Memory. If Do is a "1 " and a VME Bus read operation takes place the variable length data word is 

w readback. Similarly a VME Bus write operation will write the variable length image data word into the Base 
Memory. 

VME Bus Read Operation is summarized as follows: 



Graphics 


Image 


Sign 


VME Control Register 116 






Extend 




0 


0 


0 


All 1 6 bits will read as zero 


0 


0 


1 


All 16 bits will read as zero 


0 


1 


0 


Read only image data, all bits defined as graphics will 








read as zero 


0 


1 


1 


Read sign extended image data, graphics bits will be 








ignored 


1 


0 


0 


Read all graphics bits that their RAV bit set, cleared 








graphics bits and image data will be read as zero 


1 


0 


1 


Same as above 


1 


1 


0 


Read all graphics bits that have their RAV bits set and 








image data, cleared graphics bits will read as zero 


1 


1 


1 


Read sign extended image data, graphics bits will be 








ignored 



30 

VME Bus Write Operation is summarized as follows: 



Graphics 


Image 




0 


0 


No actual write is performed 


0 


1 


Only data defined as image data will be written to memory, the graphics 






bits will not be disturbed 


1 


0 


Only graphics bits with their RAV bits set will be written to memory, image 






data and graphics bits with their RAV bits cleared will not be disturbed 


1 


1 


Only graphics bits with their R/W bit set and image data will be written to 






memory, graphics bits with their RAV bits cleared will not be disturbed 



45 



50 



55 
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Similarly the 16 bits of the NIM control register 114 are assigned as follows: 



10 



15 



°15 D X4 0 



13 °12 



< Graphics R/W > 
Control 

0 - Disable R/W 

1 - Enable H/W 



JLJL 



11 



lilt 

°ll D 10 °9 °S 

< Only Defined > 
Graphics Bits 
R/W Control 



1 

1 1 

- 1 1 1 
till 

°J D 6 °5 D 4 



< Define > 
Image or 
Graphics 

0 * Image 

1 ■ Graphics 



*3 °2 °l °0 
<Unused> 1 



Image Data Rea4/Write Control >- 



20 



25 



30 



35 



Dis : D12 are graphics read/write control bits for the independent graphics planes. If any of the bits are set 
to a "1" then a read operation from the NIM will read back that graphics bit. Likewise a write operation will 
only affect those bit planes whose control bits are set to a "I". If any of the four control bits are "0" then a 
read operation will read back a zero "0" in that bit position. Similarly a write operation will not affect those 
bit planes. 

Dn : Db are graphics read/write control bits only if the bit positions are defined as graphics bits by the 
nibble DyiD*. If any of the bits are defined as graphics bits, their read/write operation is similar to D15D12. 
D7 : D* define which bits in Di 1 :Dg are graphics bits and which bits are associated with the image data 
word. D7 defines bit Dm, similarly Dt defines D10 and so on. Any bits in DyiD* which are set to a "1" will 
define that corresponding bit in Dnibs as a graphics bit, likewise any bits set to a "0" will define its 
corresponding bit as an image bit. It is important to note that bits which define the data as part of the image 
data word must be contiguous and start at D*. For example an 8 bit image data word would not have any of 
the bits in D7:D* set to a "0". This now leaves an extra four bits, Di 1 :Ds, as graphics bits making a total of 
8 graphics bits. Dis:Db, available with independent read/write control. A 10 bit image data word would have 
the bit pattern "1100" in D^:D? which defines data bits Db and Dg as image data bits with Dn and Di 0 
defined as graphics bits and are available as graphics bit if needed. 



BIT PATTERNS 


IMAGE AND GRAPHICS # of Graphic Bits 


DATA FORMAT # of Image Bits 


D7 


Ds 


Ds 


D 4 


1 - 


1 


1 


1 


8, 


Ds : Dts 


8, 


Do : D 7 


1 


1 


1 


0 


7, 


D9 : D 1S 


9, 


Do : Ds 


1 


1 


0 


0 


6, 


Dio : Dis 


10, 


Do : D9 


1 


0 


0 


0 


5, 


Dn : D15 


11. 


Do : Di 0 


0 


0 


0 


0 


4, 


Di 2 : Dis 


12, 


Do : Di 1 



40 



45 



D 3 : Di are not used. 

Do controls that NIM's read/write operation on the variable length image data. If Do is set to a zero ("0") and 
so a NIM read operation takes place the variable length image data word will be read back as all zeros CO"). 
Likewise a NIM write operation will inhibit any variable length image data being written to the base memory 
10. If Do is a "1" and a NIM read operation takes place the variable length data word is readback. Similarly 
a NIM write operation will write the variable length image data word into the base memory 10. 

Summarizing the design of the base memory 10. it is a triple ported memory including network 
55 interface port 110 (19 address lines : 32 data lines ); image processor interface port 1 1 8 (22 address lines : 
16 data lines); and VME bus interface port 112 (24 or 32 address lines (selectable), 32 data lines). The base 
memory 10 can hold any number of different sized images up to a single 2048 x 2048 x 16 bit image. The 
image data can be variable from 8 bits to 12 bits, with graphics data in the remaining 4 bits to 8 bits, and 
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simultaneous memory requests are arbitrated in by the arbitrator 1 09 in 50 nanoseconds. 

In operation of the NIM port 110. a single network requests transfers 8 pixels to or from the base 
memory array 10' in 550 nanoseconds. Data transfer during a write operation is controlled by a masking 
register 11 0' shown in FIGURE 2.2.1, under control of the control register 114, which allows individual 
graphics bits and/or imgae data to be written to memory. 

In operation of the IP port 1 18 an image processor request reads 8 pixels from the base memory array 
10' in 55 nanoseconds. 

In operation of the VME bus interface port 1 12, a VME bus request transfers 1 or 2 pixels to or from the 
base memory array 10' in 250 nanoseconds. Data read or written to the base memory array 10' is 
controlled by a masking register 112', shown in FIGURE 2.2.1, under the control of the control register 116. 
which allows individual graphics bits and/or image data to be accessed. During a read operation, 2's 
complement image data can be sign extended to 16 bits. 

The 2048 2 base memory occupies the upper 8 Megabytes of the MC 68000's i.e., the CPU 16's, 
address space, starting at 800000 hex to FFFFFE hex. An image pixel stored in the base memory is 
represented by a 16 bit word. 

From the above description, it is seen that the base memory 10 is triple ported with completely 
separate data and address busses dedicated to each port. The data stored in the base memory 10 is 
organized with the graphics overlay bits in the upper bits and a variable length image word stored in the 
lower bits. The image word can be as small as a 8-bit pixel ( D?:Do ), or as large as a 12-bit pixel ( Dm :D 0 
), or any size in between. With this organization the most significant nibble ( Di 5 :Di 2 ) contains four 
graphics overlay bit planes with independent read/write control. The next most significant nibble's bits ( 
Di i :Ds ) can be a combination of graphics data and/or image data. 

VME bus data read/write operations can access the base memory 10 in either Word or Longword data 
formats. 

IMAGE PROCESSOR 

Next described in more detail is the structure and operation of the IP 12. 

The IP 12 is positioned between the base memory 10 and the display memories 14. It is responsible for 
30 controlling the transfer of image data from the base memory 10 to the display memories 14. It is also 
responsible for executing image processing functions on the image data as it passes from the base 
memory 10 to the display memories 14. 

A fundamental requirement for a PACS image display workstation is the multimodality display capabil- 
ity. A multimodality image receiving station must be able to display images of different physical sizes and 
35 dynamic ranges. To satisfy this requirement, the image processor 12 is designed to accommodate images 
of any size, from 4x4 pixels to 2048 x 2048 pixels. It can read any one of the images present in the base 
memory 10, and write it at any location on either of the output image displays. In the process of transferring 
the image, a left to right reversal (X flip) and/or top to bottom reversal (Y flip) ran be performed to 
compensate for improperly recorded images. 
40 Image subtraction is required to visualize low contrast details that have been obscured by overlaying 
structures. An example is in angiography, where a pair of images is recorded at exactly the same location. 
One is recorded before a procedure begins and the second is recorded after a contrast media has been 
introduced. By subtracting the two images, the obscuring structures that are present in both images are 
eliminated. The IP 12 includes subtractor 1 10 to satisfy this requirement. 
45 Contrast enhancement has been provided in many medical electronic display systems. The terms 
"window" and "level" are used in the medical community to describe this capability. The image viewing 
station of the invention includes the lookup table (LUT) 1 02 that is used for contrast modification. It can also 
be used to reverse the grey scale if desired. 

Another aspect of the multimodality display requirement is the ability to simultaneously display images 
so that have different dynamic ranges. The LUT 102 that performs the contrast modification is also used to 
normalize the dynamic range of all input images to 8 bits (256 grey levels). 

Much of the wide dynamic range encountered in medical images is generated by large structures that 
are not of diagnostic interest. The spatial filter 1 04 has been included in the IP 1 2 to reduce the intensity of 
these structures. This will allow more of the diagnostically significant anatomy to be visible simultaneously 
55 on the CRT. This filter can also be used to reduce the noise present in some radiographs. 

A problem with previous attempts at the electronic display of medical images has been the inability to 
match the spatial frequency of the image structures to that of the observer's eye. In a film-based system, 
this match is accomplished by moving either the film or the radiologist's eyes. In early electronic systems 
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hardware, zooms were attempted. These systems could only provide integer zooms, i.e. factors of 2 or 3 
etc. An increase in size by a factor of 2, the minimum step for these systems, was more than a radiologist 
desired. At this point, 75% of the image was not visible. The image viewing station of the invention allows 
zoom factors from a minification of 1/32 (zoom factor of .013) to a magnification of 2048 (one pixel mapped 

5 to the entire output screen) in steps of .031. 

The image data input to the IP 12 consists of 12 data bits and 8 graphics bits. The method of assigning 
the 16 bits in the base memory 10 to these functions is described above. The image data output from the 
IP 12 consists of 8 data bits and 1 graphics overlay bit. The control processor (CPU) 16 controls the IP 12 
by loading values into IP registers and tables, in particular the LUT 102. These registers and tables appear 

io in the address space of the CPU. The IP is a pipelined architecture that performs the following sequence 
functions: 

1. sequential address generation required to read the source image data from the base memory (Fig. 
3.5.6); 

2. image subtraction between two images that reside in the base memory; 
is 3. contrast enhancement manipulations on the image data; 

4. spatial filtering on the image data; 

5. continuous zoom (COZO) to magnify and minify the displayed image; 

6. sequential address generation required to write the processed image data to either display memory; 

7. histogram operation on selected regions of the image identified by the Region of Interest (ROI) 
20 overlay bit. 

Functions 1 through 6 are concerned with manipulation of the grey scale image data. The last function 
is to compute the image statistics that are used by the CPU when executing various image processing 
algorithms. Each of the seven processing functions will be described in detail below following a discussion 
of their sequencing. 

25 The sequence of processing operations performed by the IP on the grey scale image data is critical for 
successful operation. The reasons for this sequence are: 

1. The subtraction operation must come first. For the subtraction to be successful, it requires the full 
dynamic range of the source images. 

2. The contrast manipulation operation must precede the filtering operation. First of all, the contrast 
30 mapping needs to operate on the full dynamic range of the input data to visualize subtle contrast 

variations. Secondly, the filtering operation can reduce the number of grey levels in the output image. 
This can cause contouring to be visible in the image when the contrast manipulation is performed after 
the filtering operation. 

3. The filtering operation must be performed before the zoom operation. The zoom changes the spatial 
35 frequency (in cycles/pixel) of the displayed image. If the filter operation were performed after the zoom, 

the effect of the filtering operation would change as a function of the image magnification or minification. 
As shown schematically in FIGURE 1.1, the IP 12 includes base memory address generator 122, the 
details of which are shown in FIGURES 3.1 and 3.5.6. It is responsible for generating the address and 
control information required to read the desired image data in the desired order from the base memory 10. 

40 The central component of the address generator 122 is the pixel address counter 124. The pixel address 
counter 124 contains the address in the base memory of where the next pixel to be processed is located. It 
must be 22 bits wide so that it can address the 4 million pixels present in a 2048 x 2048 image. As part of 
the IP initialization sequence, the CPU 16 loads the address counter 124 with the locations determined by 
offsets generated in the X Delta and Y Delta registers 126 and 128, respectively. 

45 The X and Y Delta registers 126 and 128 are initialized to zero as part of the IP initialization sequence. 
The X Delta register 126 is incremented by one for each pixel transferred in a normal left to right display. If 
a left to right image reversal {X flip) is requested, the counter is decremented by one for each pixel 
transferred. Depending upon the roam and zoom requested, the last pixel required by the IP will come from 
a position along the line, in general not the last pixel of the line. The Y Delta register 128 contains the offset 

so needed to position the pixel address counter 124 to the beginning of the next line to be transferred. If a top 
to bottom reversal (Y flip) is requested, this offset will be negative. 

As mentioned above, the CPU 16 loads the pixel address counter 124 with the first pixel to be 
transferred. In a normal display, this will be the pixel that appears in the upper left corner of the displayed 
image and the X delta register 1 46 will count forward to the last pixel on the line. In a display with an X flip, 

55 the first pixel addressed will be the last pixel on the line and the X delta register 126 will count backwards 
towards the first pixel. In a display with the Y flip, the first pixel addressed will be the first pixel on the last 
line. In a display with both the X and Y flip enabled, the first pixel addressed will be the last pixel on the last 
line. 
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As shown in FIGURE 1.1, image data from the base memory 10 is operatively coupled to the subtractor 
100 of the IP 12. The primary purpose of this, shown in more detail in FIGURE 3.2, is to form the difference 
between image pairs as is commonly done in intravenous angiography. The method of generating the 
addresses of the conjugate points in the two subtracted images has been presented above. Image data 

5 points are read in pairs from the base memory 10 and N-1 hold register 129. The input pair is then input to 
an arithmetic and logical unit (ALU) 130 for processing. The output of the ALU 130 is the input to the 
contrast enhancement LUT 102. One input to the ALU 130 can also come from a constant register 132. This 
allows logical or arithmetic operations to be performed between the input image data and a constant (e.g. 
add a constant to an image). 

w The output of subtractor 100 is applied to lookup table (LUT) 102 used to perform contrast enhance- 
ment functions. This table transforms pixels with up to 12 bits of dynamic range (e.g. 4096 grey levels) to 
an 8 bit output pixel, compatible with the rest of the IP stages. This LUT is actually used to perform three 
functions. The first is contrast enhancement. The CPU 16 computes a set of values that will perform the 
desired contrast modification and loads them into the LUT 102. If the user has selected grey scale reversal, 

js the values loaded into the LUT 102 are computed to produce that effect. The LUT 102 is also used to 
transform the dynamic range of the input image to the 8 bit quantity used by the IP 12. In this way any 
dynamic range from 1 bit to 12 bits can be accommodated. The third function that can be performed in the 
LUT 102 is the conversion of unsigned binary data to 2's complement data. All of the data types referenced 
above are allowed by the NEMA (National Equipment Manufacturers Association) standard. 

20 The output of the LUT 102 is applied to the spatial filter 104, which consists of a 32 delay finite impulse 
response (FIR) filter. I can be used to perform any filter function that can be accommodated in 32 days. The 
most common use for this type of filter is to provide high and low pass filtering of the image data. A 
symmetric FIR filter is desirable for this application because it produces linear phase response which will 
not produre any ringing in the image. The output of the FIR filter is buffered in two memories, each of which 

25 can hold one line of filtered image data. These buffers contain two lines of data that become the input to the 
continuous zoom processor 106. 

The continuous zoom processor 106 is designed to provide an accurate reproduction of the input image 
at all magnifications. Bilinear interpolation is used to compute the output pixel values. This is done to avoid 
the "blocking" that is apparent when pixel replication is used. The equations for the bilinear interpolation are 

30 shown in FIGURE 3.3. The output grey level G is the weighted sum of grey levels present at the pixels four 
nearest neighbors A, B, C and D. The pipelined COZO processor 1 06 that solves the interpolation equation 
is shown in FIGURE 3.4. 

In Figure 3.4, pixel data A and B are supplied from the line buffer (not shown) within the IP 12, and 
pixel data C and D are supplied directly from the filter circuit 104 into subtractors 202. The results of the 

35 subtractors 202 are multiplied by COZO coefficients X, and Y which are generated from an associated 
COZO coeffrcent generator (123) in multipliers 204. Then, the outputs of the multipliers 204 are added to 
one another in adders 206, according to the above formulas, to generate the estimated pixel G to the 
display memory 14. Double COZO 106, i.e., a pair of zoom processors 106, may be provided to accomplish 
pipeline processing in parallel on multiple picture data thereby to reduce the user's wait time for viewing of 

40 desired images, or for another purpose of performing the same COZO process on overlay graphic images 
stored in the associated graphic overlay plane of the base memory 10. 

Magnification is performed by COZO 106 by computing more than one output pixel for each input pixel. 
The level of magnification is determined by the size of the X and Y multiplier coefficients. The initial values 
of these coefficients are loaded into the IP 12 by the CPU 16. Also the deltas that increment the X and Y 

45 coefficients on successive pixels are computed by the CPU and loaded. As each output pixel is generated, 
a new X and Y coefficient is computed by adding the appropriate deltas. The point where the output pixel 
has advanced beyond the current 4 pixel neighborhood is signaled when one or the other of the coefficient 
magnitudes exceeds one. 

The grey level values present at the current pixel's four nearest neighbors are held in registers labeled 
50 106.3, 106.4, 106.5, and 106.6. These values remain constant as long as the current pixel position remains 
within that current four pixel neighborhood. For a zoom of 4, four output pixels would be generated from 
within each 4 pixel neighborhood. Once the output pixel position advances along the line (as signaled by 
coefficient overflow described above) and is no longer between the current four values, new values are 
loaded. The current value in the B register is transferred to the A register and the current value of the D 
55 register is transferred to the C register. New data values are loaded from the input buffer memories into the 
B and D registers. This process continues until the entire output image has been generated. 

Minification is also performed using the COZO 106. Minification is very important in this application for 
two reasons. First, it allows the radiologist to have many images, some in reduced format, displayed on the 
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screens at the same time. Second, it permits the display of images that contain more pixels than are 
available on the output display. The full resolution of the original image can still be visualized by using the 
magnification zoom capability. The minification allows the radiologist to view the entire image at reduced 
resolution. 

5 Minification is performed by first computing an appropriate magnification factor that falls between one 

and two. Then an integer divide (performed by discarding pixels) is used to achieve the desired minification. 
As an example, consider an image where the desired minification is .75. This minification is accomplished 
by first computing coefficients that will yield a magnification of 1.5. Then every other pixel is thrown away 
106.1, performing a divide by 2, and yielding the desire minification of .75. A similar operation is performed 

w on the lines 106.2 to achieve minification in the vertical direction. 

The IP 12 further includes the output pixel address generator 134 for generating address data applied 
to the display memories 14 via the memory controller 138, as schematically shown in FIGURE 1.1. The 
output pixel address generator 134 consists of a pixel counter and a line offset register (not shown). The 
address that represents the position of the upper left pixel of the output display is loaded into the pixel 

is counter register. Pixels are then stored sequentially (four at a time) until the current line is completed. The 
offset register is then added to the pixel counter to address the first pixel on the next line. This cycle is 
repeated until the entire output image has been written. 

Further, the IP 12 includes the histogram processor (HP) 108 designed to compute the histogram of 
grey levels of an image as it passes through the IP 12. The HP 108 is positioned in the pipeline after the 

20 subtracter 100 and before the contrast mapping LUT 102. This position yields a histogram of the input 
image data unaffected by the image enhancement processing which follows in the IP. The histogram of any 
region (or regions) in the image can be computed. One of the graphics overlay bits in the base memory 10 
is used to enable and disable the HP 108. 

The HP 108 consists of a high speed memory and an add by one counter (not shown). The first 

25 requirement in using the HP 108 is to set all values of the histogram memory to zero. The CPU performs 
this operation by writing zeros into all of the memory locations. Next, the image data is cycled through the 
IP. The grey level value of each pixel forms the address of the corresponding bin in the high speed 
memory. The value at that address is read, incremented by one, and written back at the same location. This 
process continues for each pixel in the image that has been enabled by the graphics overlay bit. 

30 

DISPLAY MEMORY 

Next described is the function and operation of the display memories 14. The display memories' main 
purpose is to provide the digital video information to the video display monitors surh that a continuous 

35 flicker free image is being displayed at all times on the video monitors. The displayed image is comprised 
of 1024 pixels by 1536 lines by 9 bits. 8 bits are used for the grey scale image presentation and the ninth 
bit is use as an associated graphics overlay bit. This memory array matches the 'page format* or 'portrait 
format* used by the display monitors. Such a display format was chosen since its aspect ratio matches 80% 
of the images currently generated in a radiology department which are 14" by 17" chest images on film. 

40 The display memories 14 are also triple ported to provide fast access to the display memory buffers 
14i and 142. As shown in FIGURE 4.1, one port 142 is dedicated to the image processor 12 which allows 
processed image data to be quickly transferred to the display memory buffer. A second port 144 is 
dedicated to the video display monitors 18. It provides the screen refresh necessary for a continuous image 
to be displayed on video monitors 18. See FIGURE 4.1.2. The third port 146 is connected to VME Bus 

45 which allows random read/write access of the display memory buffers. 

The image processor port 142 allows the image processor 12 random access to the either or both 
display memory buffers 14i and 142. This feature allows many different sized images to be placed into the 
display buffers, and allows an image to be moved and its size changed during the zooming and minification 
of that image. 

so The video display monitor port 1 44 is a high speed port used to provide a continuous stream of data for 
the display monitors 18 via the display controller 138. The entire contents of a display memory buffer is 
read out during one video frame time and displayed on a video display monitor 18 except during the movie 
loop program. 

Each display memory board includes two 1024 x 1536 x 9 bit image buffers 14, and 14s. This dual 
55 buffer architecture allows one memory buffer to be currently refreshing the display monitor while the other 
memory buffer is being updated by the image processor 12 or by the VME bus 28. After the update is 
completed, the video display monitor 18 is switched to the updated display buffer, again via the display 
controller 138, allowing the user to view the completed image. This architecture provides the ability for the 
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entire contents of one buffer to be copied into the second buffer in one video frame time. Such a feature is 
useful when the image processor is moving small images overlaid on top of a larger field of images. 

Each display memory 14 can hold a series of images that can comprise a movie loop of up to forty- 
eight 256 x 256 x 9 images per display memory. The viewing station of the invention has two display 

s memories and is capable of displaying a movie loop up to ninety-six frames (see FIGURE 4.1.1). In the 
movie loop mode the 256 x 256 images are zoomed in the display memory hardware 148 shown in FIGURE 
4.1.2 by a factor of four to provide an image area on the display monitor equivalent to a 1024 x 1024 image 
viewed at full resolution. An image pointer register is accessed by the CPU 16 via the VME bus 28 to select 
which 256 x 256 image is to be displayed. Thus the movie loop's sequence of frames and it's length are 

70 totally controlled by the software. The video sync generator 150 of the display memory refreshes the video 
display monitor at a rate of 40 frames per second. At the end of each video frame the hardware generates 
an interrupt which in turn synchronizes the movie loop software with the display memory hardware. This 
now allows movie loops to be displayed forwards and barkwards at variable frame rates from still frames to 
40 frames per second. The variable frame rate is given by: 



15 



Frame Rate - 40 P«r Second 

N 



where N is an integer and N £ 1. 
To help in referencing how the window and level settings are mapping the active displayed image, a gray 
scale wedge is constantly displayed on the right hand side of the active image area on the video display 
monitors. Four unique markers 152 are individually enabled and placed on the gray scale by the software. 
25 As the. window and level settings are changed the software can reposition the markers to reflect the new 
window and level settings. 



DISK DRIVE 



30 To ensure fast storage and retrieval of many large images to be used locally on the image reviewing 
station, a high speed disk drive 30 is integrated into the system. The disk drive 30 is a Fujitsu model 
M2333K unit with a storage capability of 337 Megabytes and a serial data transfer rate of 24 Megabits per 
second. To take advantage of this disk drive's speed and improve the Review Console's image transfer time 
a hard disk controller 32 in FIGURE 5.1 . is provided designed to interface the disk drive to the system. 

35 The disk used to store images in the review console is a Fujitsu M2333, with the specifications: 



Storage capacity 


337.1 Mybtes unformatted 


Transfer Rate 


2.458 Mbytes/sec (19.664 Mbits/sec) 


Cylinders 


823 


Tracks per cylinder 


10 


Track capacity 


40960 bytes unformatted 


Cylinder capacity 


409,600 bytes unformatted 


Rotational speed 


16.66 ms/turn 


Positioning time, track to track 


5ms 



In order to make maximum use of disk space and shorten the length of time to transfer an image, several 
unique things were implemented in this controller: 

1. Each track is formatted as a single sector of 40880 bytes to avoid losing time and capacity to multiple 
so sector overhead. 

2. An automatic track switch occurs once a revolution of the disk at the index pulse, avoiding processor 
software involved in telling the controller to do this. This enables continuous image transfer across track 
boundaries. 

3. An automatic seek to the next cylinder occurs after the last track on a cylinder is transferred. Again. 
55 this avoids processor overhead for a seek to the next cylinder. 

4. In order to cope with the rapid housekeeping involved in doing things 1 ,2,3 above, sequential logic is 
used for the control of these functions rather than the usual approaches of using a processor or a slow 
state machine. 
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5. Data is transferred to and from the VME bus via a short FIFO (16 words deep) rather than transferring 
to and from an on-board sector memory to avoid the transfer latency and complexity involved in such a 
scheme. 

6. No attempt is made at error correction, since that would take additional time and require an on-board 
s processor and sector memory. (Error correction is not as important in a large image as it is for numerical 

or program data.) However, a cyclic redundancy check (CRC) 190 is done on each track transferred to 
assure the integrity of the disk surfaces. 

As a result of the disk formatting, the following specifications apply, to the disk: 



10 


Track capacity 


40880 bytes 

20440 16-bit words (pixels) 




Cylinder capacity 


408,800 bytes 
204.400 words (pixels) 


IS 


Disk capacity 


336.442 Mbytes 

168.221 Mwords (Mpixels) 

160 images 1024 2 




1 024 2 image: 




20 


occupancy 
transfer time 


52 tracks 

57x1 6.66ms = .950 s (5 turns lost to cylinder seeks) 



Looking at the block diagram, the disk drive (30) itself is linked to the controller by a modified SMD 
25 interface including: 

Serial data and clocks (I9.60mhz) 

Status bus 

Index pulse 

Tag bus 
30 Tag word control. 

To initiate a data transfer, the system CPU loads: 

1. Cylinder counter 162 with the start cylinder (this initiates a seek to that cylinder automatically), 

2. Head counter 1 60 with the start track, 

3. DMA address counter 172 with the address of the image/data memory on the VME bus. 
35 4. Transfer word counter 168 with the number of words to be transferred. 

5. Control word register 1 64 with the operation to be done: read or write; this initiates the whole transfer 
operation. 

When the timing control 174 sees that the disk is on the proper cylinder, it proceeds to transfer tracks 
of data until the transfer word counter 168 decrements to zero, signalling the timing control 174 and the- 
40 DMA control 170 to cease transfers and providing an interrupt back to the system CPU to tell it the transfer 
is completed. If no DMA transfer is done for 82 msec before the transfer is completed, the timeout counter 
1 76 also tells everyone that the transfer is done and sets a bit in the status word 1 66. 

The DMA controller 170 is a state machine that controls transfers from the FIFO 180 through the 
parallel/serial shift register 182 to the VME bus 28. It is capable of doing 16 or 32 bit transfers: however. 
4s most memories on the VME 28 bus are not fast enough to keep up with the speed of the M2333K disk 30 
when doing 16 bit transfers, so this is usually a 32 bit transfer. The DMA controller 170 handles the VME 
bus arbitration, acquisition and control, increments the DMA address counter 172, and decrements the 
transfer word counter (168). 

Each track transfer is controlled by the track timing control 174. The sequence is: 
so 1 . receive index pulse from disk 30, 

2. issue head count tag 160 to disk 30, 

3. issue control word 164 to disk 30 (read or write), 

4. wait for sync word 183 (read or output sync word 183 (write) to disk 30, 

5. transfer 20440 words (16 bit) via shift register 182. 

55 6. check CRC word 166 (read), or output CRC word 166 (write) to disk 30. 

7. tell head counter 160 to increment, 

8. if necessary, tell cylinder counter 162 to increment and the disk 30 to do a seek to next cylinder, 

9. wait for next index pulse from disk 30. 



16 



EP 0 258 976 B1 



The Cyclic Redundancy Check 166 implements the CRC-16 algorithm in discrete logic {for sufficient 
speed). CRC-16 uses the polynomial X16 + X15 + X2 + 1. If an error is detected on any track in the 
transfer, a bit is set inthe status word (166) for the system CPU to read. 

For further information on the disk/disk controller, see M2332K/M2333K Disk Drives Engineering 
5 Specifications . Fujitsu. Limited, 1984. #B03P-4760-01 01 A. and Kong, Vivian "Implementation of 
Serial/Parallel CRC Using PAL Devices," Systems Design Handbook , 1st Ed. Monolithic Memories Inc. 
1983, pg. 2-57. 

Several speed improving measures were incorporated into the disk controller. Instead of having several 
sectors per track as typically seen implemented, a sector is now equal to a track. The disk controller 

io provides automatic head switching and cylinder seeking until the entire file that was requested is 
transferred. The CPU only has to tell the disk controller the starting location, set in DMA address counter 
172, of the image file and how many bytes it is, set in transfer word counter 168. and start the disk 
controller 32. The DMA controller 170 will then request the VME bus 28 to become bus master. Once it 
receives the bus grant and becomes the bus master the disk controller 32 will transfer the image data to the 

js base memory 10. When the disk controller 32 has transferred the entire block of image data it releases the 
VME bus 28 and interrupts the CPU 16 to inform the software that the data has been transferred. 

By way of further explanation of the disk controller 32, it is noted that the disk 30 has ten heads. As 
shown in FIGURE 5.1. head counter 160 controls which of the ten heads is actively reading or writing the 
disk 30. The cylinder counter 162 controls which of the 823 cylinders are being accessed by the selected 

20 head. The control word register 164 specifies what action the disk will perform, such as Write, Read, RTZ 
(return to zero), Interrupt Enable, 1 6 or 32 bit wide data transfer, etc. Status word register 1 66 tells the CPU 
the status of the I/O operation, such as DONE, or ERROR FLAG. The transfer word counter 168 (16 bits) is 
loaded with the number of words to be transferred, and DMA controller 170 and DMA counter 172 enable 
the disk controller to transfer data directly from the disk into the base memory 10. 

25 

INPUT EQUIPMENT 

The CPU input equipment 34. otherwise known as the desk subsystem, provides an intelligent I/O 
subsystem to the digital viewing station. Its function is to collect input from the various sources attached to 

30 it and send the data on to the workstation over a single serial channel. The input sources available to the 
desk, as it has been reduced to practices, are: six shaft encoders, one trackball, three touch screens and an 
ASCII keyboard (FIGURE 6.1). There is no architectural limitation on these input sources. The touch screens 
are chained through a single RS-232 channel into the system. The shaft encoders and trackball share a 
parallel input channel. The trackball is essentially two shaft encoders manipulated by the ball, with one 

35 encoder affected by motion along the x-axis and the other affected by motion along the y-axis. 

The controlling software which executes on the desk resides in ROM and is almost entirely interrupt 
driven. The shaft encoders generate 512 interrupts per revolution. The software simply counts interrupts 
and returns the count when queried by the host system. The counter is then reset to zero. The touch 
screens generate and interrupt when activated and pass an ASCII string to the desk. This string is collected 

40 into a buffer, with an offset added if necessary, and passed along the host system. The keyboard generates 
an interrupt for each character. Keyboard input is passed to the host system immediately, with no 
preprocessing. While no interrupts are active, the software idles by checking to see if any touch screen 
strings have accumulated in the buffer, and waiting for a query from the host system. 

Keyboard input is passed directly to the host system as it is received. Touch screen input consists of 

45 strings of characters which are accumulated in a buffer by the interrupt service routine. When the software 
is idle it checks for the presence of data in the buffer and sends it to the host. The input from the encoders 
and trackball accumulates into counters, one of each distinct input. These inputs are not passed onto the 
host until it specifically queries the desk by sending a A T (Control T) character. To ensure that none of the 
counters is overlooked, the software scans them in a circular fashion starting from the counter following the 

so previously read counter. Each counter has a flag associated with it which indicates whether the encoder has 
been adjusted. If a counter is empty, i.e. the encoder has not been turned, it is stepped over and the next 
counter checked. The first counter in sequence which has been changed will be sent to he host. At the 
receipt of the next query the scan will start with the succeeding counter. If all the counters are scanned and 
none are found to have changed, the query is remembered. Then, if an encoder is changed, the count will 

55 be sent to the host immediately. 

Besides the query command C*T) the desk software responds to two other commands from the host 
system. The enable command ( * B) will reinitialize the software and reset the encoder and trackball deltas. 
It is generally sent by the host only at startup time. The disable command ( * V) disables the encoders and 
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trackball, but does not affect the touch screens. The encoders and trackball are re-enabled by ~ T or ~ B. 
The output language generated by the desk is defined by the following production rules: 
(desk output) -> <vector>CR | <kbd> 

(vector) --> * A(enc | tkb) |. ~ E(comts> | * Rimgts) | ~ G)imgts) 
5 (enc) -> (a | b | c | d | e | fXnumS) 

<tkb) --> g(num5),<num5> 

(comts) --> (num3),(num3) 

(imgts) --> <XXY> 

(num3> -> t-Kddd> 
w (num5> »> [-Kddddd) 

<d> -> (0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9> 

00 --> x (where x is an integer in range of 32 to 142) 

<Y> --> y (where x is an integer in range of 32 to 122) 

(kbd) --> c (where c is an ascii character) 
T5 Note: [ ] => enclosed item is operation. ( ) enclosed non-terminal symbols. Bold symbols (e.g. ~F) are 

terminal symbols. A A, ^ F, A E, ^ G and CR are symbols, not pairs of characters 

SOFTWARE SYSTEM 

20 The functional capabilities of the radiologic image viewing station, and the means to utilize them, are 
presented to the physician by the User Interface. This interface is implemented by software executing on 
the host cpu system, aided by independent software executing on the desk subsystem's processor. On the 
host cpu the software system controls the physical resources to establish a feedback loop with the user 
(FIGURE 7.1). The software displays command menus and text, as well as the digital radiographic images. 

25 The user manipulates the menus and images directly, by way of the touch screens, and indirectly through 
the encoders, trackball and keyboard. On the desk subsystem 34 the software implements an intelligent I/O 
processor which multiplexes the various input sources into a single serial stream for processing by the 
interface software on the host cpu. The system displays its command interface and images, receiving 
feedback from the user through the desk subsystem 34. The user activates commands and manipulates 

30 images, again through the desk subsystem 34, and receives feedback from the system through the 
command and image displays. 

Image Control Model 

35 The implementation of the user interface is based upon a logical model of the task of viewing pictures. 
In this model the control of images mimicks a desk top (display) upon which pictures (images) may be 
placed, possibly overlapping. We may visualize a physician sitting at this desk viewing the images (FIGURE 
7.2). He will want to place other images onto the desk, or remove images from the desk. Additionally, he 
may want to move an image about on the desk, or flip the image vertically or horizontally. Since an image 

40 may be overlapped or totally covered by other images the physician will sometimes need to select a 
covered image and bring it to the top for viewing. The user interface adheres to this model by providing 
touch screen inputs to allow the manipulation of images directly on the display screen, much like the 
physical handling of pictures on the desk. The command menus provide the capability to move images into 
and out of the display, modeling the physicians ability to move pictures to and from the desk. If we expand 

45 the original model to include a drawer in which to store pictures which are not on the desk, the physician 
should be able to easily get a picture from the drawer and place it on the desk. The pucture drawer is 
implemented in the interface as a pool of available named images. A list of the image names allows quick 
selection of images for display. Logically this pool may be of nearly unlimited size. Extending the model 
one step further, the physicians picture drawer would be supplied from some source outside his office (e.g. 

so X-ray room). The user interface similarly provides for the addition of images to the pool of named images 
from the external archive over the communications network. This model, however, abstracts only the 
aspects of image control corresponding to the physical handling of pictures by this imaginary physician. It 
may be extended by abstracting the pictures themselves to model the aspects of image control which 
concern processing, or mathematical handling, of the images. This abstraction has no physical counterpart 

55 in the desk top model, but rather details analytical tools provided by the workstation to aid the physician in 
attaining an accurate diagnosis from the image. 
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Abstraction of Images 

The model above is supplemented by considering the pictures used by the physician to be named, 
dynamic objects. The objects themselves consist of the image data as well as associated data such as 

s patient demographics and parameters involved in the acquisition of the data. These picture objects make up 
the pool of pictures distributed between the drawer and the desk top in the above model, and may have 
three global states. Objects in the Inactive state are those pictures in the drawer which have not been 
selected for viewing. The pictures which are on the desk top, but which are not currently the focus of the 
physicians attention, are Ready. The single picture upon which the physician is concentrating, and which he 

w may manipulate, is in the Active state. Objects which are on the desk top, that is Ready or Active, maintain 
a state vector which controls specifics of the object's state. This vector changes dynamically as the object 
is manipulated but is not affected by transitions between Ready and Active states. This allows the physician 
to shift his attention between picture objects and when he returns to a picture he previously looked at its 
state remains the same as he left it. The object's state vector is created when it moves from Inactive to 

is Active, corresponding to the physicians removal of the picture from the drawer and placing it on the desk. 
By considering the pictures to by dynamic objects we can add power to the original model by supposing 
that the dynamic portions of the state vector may be initialized by any allowable value. So if the imaginary 
physician wants to see all pictures of a specific type (say, chest images) with the contrast reversed and 
placed at a specific location on the desk, he initializes the objects state vector with the appropriate values in 

20 the process of moving it from the drawer to the desk. Of course, in the implementation of this model by the 
user interface software the picture objects are a combination of the image and demographic data and 
controlling data structures. The state vector is initialized from a set of default values established for each 
user and used to program the image processor so the image appears on the monitor as desired. 
Manipulation of the Active image changes the state vector while Ready images' state vectors remain 

25 essentially static (FIGURE 7.3). 

The following is a discussion of primary data structures. 

Disk structure and directory control track (DCT). 

30 The disk system is viewed by the software as a linear sequence of tracks. For the system as reduced 
to practice these tracks are 40880 bytes in length and there are 8230 of them. The software imposes a 
structure on this sequence of tracks to allow for the efficient use of the disk for image storage. The structure 
also partitions the disk into regions used for system operations and for image data (FIGURE 7.4). The disk 
space occupied by data structures is relatively small, leaving about 8000 tracks available for image storage. 

35 The primary data structure on the disk is the Directory Control Track (DCT) (FIGURE 7.5). The DCT resides 
on the first track of the disk, with a backup copy on the last track. It is the key structure and maintains 
pointers to the location of all other data structures on the disk as well as the location of image data. It also 
contains the allocation bit map. When the system is powered up, the initialization code reads the directory 
control track into memory where it resides during system operation. Keeping the DCT memory resident 

40 provides more efficient access of data on the disk since nearly all disk accesses require looking up 
information on the DCT. Any activity, other than swapping, which modifies data on the disk will also cause 
the DCT to be updated on disk as well. 

Within the DCT are two bit maps. These maps each consist of one bit for each track on the disk. The 
Allocation Bit map keeps track of which tracks are currently allocated and which are free to be used. The 

45 Bad Track Bitmap maintains a map of those tracks which consistently generate errors when accessed and 
which cannot be relied upon for data storage. When space is sought for new image data, the allocation 
bitmap is searched for free tracks and the corresponding bits checked in the bad track bitmap before the 
tracks are used. When a new image is to be stored on the disk the space is sought from the pool of free 
tracks. The software attempts to allocate the space sequentially from lower to higher numbered tracks. It 

so will allow the image to be partitioned into as many as eleven segments in the current implementation. The 
Image Location List (ILL), another structure within the DCT, is used to image the tracks allocated to image 
data (FIGURE 7.6). 

In the ILL one entry is maintained for each image on disk. Each entry in the ILL is an Image Location 
Vector consisting of eleven ordered pairs specifying the starting track and extent of each segment of the 
55 image. Within the vector the pairs are ordered from lowest to highest according to the track number. The 
ILL is referenced when an image is read from disk. Image space may be allocated in less than eleven 
segments and may even consist of one contiguous segment. These vectors allow use of fragmented disk 
space without the need to compress the disk. 
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Menu Control 

The following is a discussion of menu control. 

The primary form of command input for the user interface is through touch screen activated command 

s menus. The menus are drawn graphically on the command monitor as labeled rectangular boxes with 
smaller rectangular keys within. Each key in the menu is labeled with the command name, usually chosen 
to convey the function of the command (e.g. DIR for directory). Menus are managed through the use of 
several data structures. Each menu has a Menu Descriptor which lists information necessary for the 
management of the menu. This descriptor details information about the menu as a whole, such as the 

io location of the lower left corner and the extent of the menu. This information is used to place the menu on 
the screen and to determine whether a touch on the command screen falls within the menu. The menu 
descriptor also has a pointer to a set of Key Descriptors, with one descriptor for each key in the menu 
(FIGURE 7.7). These descriptors are similar to menu descriptors except their information describes a single 
key within the menu. Each key descriptor has a pointer to the procedure which implements the function of 

15 the key. The menu descriptors are defined during the development of the software and exist in an array. 
Menus may appear or disappear from the command screen dynamically in response to user actions. To 
keep track of which menus are active on the command screen a list of pointers, called the Active Menu List, 
is maintained (FIGURE 7.8). This list is ordered by menu activation so that the most recently activated 
menu is at the top of the list. This allows overlap of menus without confusion. If two menus overlap and a 

20 touch hit occurs in the region of overlap, the top menu will be searched first and the appropriate procedure 
invoked if the hit was within a key. The hidden keys of the overlapped menu cannot be accessed without 
removing the covering menu. 

Image Parameter Blocks (IPB) 

25 

To implement images as dynamic objects which can be manipulated by the system user, a variety of 
data structures are required. These structures maintain information about the image, its associated 
demographic information, where the image resides on disk and the state of the image. Images which are 
Inactive reside solely on disk, along with their associated information. When an image makes a transition 

30 from Inactive to the Active state its associated information, and information from the user's default file, are 
loaded into an Image Parameter Block (IPB) (FIGURE 7.9). This structure maintains the state vector for the 
image and remains associated with the image as long as it is Ready or Active. Image parameter blocks 
exist in an array of free IPBs from which one is assigned when an image becomes active. The state vector 
maintained within the IPB is used to configure the image processor to display the image. Most user 

35 commands which affect the image (e.g. window/level adjustment) modify the state vector and cycle the 
image processor to redisplay the image in its new state. The initialization of the image parameter block 
requires information from two primary sources. One of the sources is a set of three image data lists while 
the second is the adaptive interface file. 

40 Image Data Lists and Adaptive Interface File 

The image data lists maintain information about the image which is divided into three classes: patient 
information (Patient Data List), study information (Image Control List) and physician information (Radiologist- 
Physicial List) (FIGURE 7.10). These data lists each require two tracks in the disk 30, one for a primary 

45 copy and one for a backup. The DCT maintains pointers to the location of the lists on disk. There is one 
entry in the list for each image on the disk. When an image transitions from inactive to active, these three 
lists are read and the entries for the image are copied into the image parameter block IPB. The information 
may simple be necessary reference data (e.g. age, sex) or may required to process the image (e.g. # 
pixels, lines). The image data lists reside on disk and are read into memory when required. The lists are 

so updated on disk when the available pool of images on disk changes. 

The Adaptive Interface File provides other information for the initialization of an image parameter block. 
This file has entries for each user who has access to the system (FIGURE 7.11). The users entry contains 
default parameter values which allow the user interface to be tailored somwewhat for each user (FIGURE 
7.12). The file resides on disk and is modified only by privileged system users. Only users with an entry in 

55 this file can log onto the system and access patient information. The file contains default values for each 
type of image the user may wish to view on the system. These parameters are used in determine the initial 
state vector for images as they are placed on the display for the first time. This tailoring prevents the user 
from having to adjust the system to his liking each time a new image is brought up on the display. 
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System Primitives and Device Support 

First considering disk service, two I/O primitives are required to support the movement of image and 
associated data to and from the disk. These services are READ and WRITE. The current implementation 
s supports synchronous I/O on disk operations. The capability for asynchronous I/O exists, however, the 
largest transfer of data are those involving images and since processing requires the entire image there is 
no desire to cycle the image processor while the I/O is in progress. The length of disk read and write 
operations is specified in words of 16 bits and may extend from less than a track to the entire disk. The 
completion of the operation generates an interrupt which is handled by an interrupt service routine. 

10 

Graphics Control 

Regarding graphics control, a set of primitive functions exists to support the use of the color graphics 
interface used for the command monitor. The functions support line and block drawing as well as screen 
is positioning. As reduced to practice the primitives also provide the emulation of a normal video terminal in 
the lower half of the command display. The upper half is used to display command menus and some status 
information. 

Display Memory Management 

20 

The display memory hardware provides two display channels, each of which has two independent 
buffers. A display output control procedure manages the use of these display channels to provide hidden 
update. Generally one buffer is displayed while the second receives update data from the image processor. 
After updating, the display may be instantly switched to the newly filled buffer. In each channel the buffers 

25 may be copied from one to the other in one frame time. The display management procedure uses this 
feature to maintain up-to-date image data in both buffers. 

Regarding network communications, network communications for the system provide the capability of 
the user to query the Archive and request images to be set to the system for viewing. The software 
responsible for this interaction manages the exchange of control messages and image data. The N1M 

30 hardware provides a highspeed port to the Base Memory and image data is placed directly into the base 
memory. Once the image has been received it may be written to disk. 

COMMAND PROCESSING 

35 The following is a description of command processing employed according to the invention, including 
command vectoring, control function processing, command dispatch, image activation and movement and 
image shuffling. 

Command vectoring . 

40 

Since all input to the user interface arrives through a single channel from the desk subsystem 34, it is 
logical to extend this centralization in software also. A single procedure, "getdesk", is used by all other 
procedures to get input of any form. To distinquish the various types of input which are available the 
procedure generates Command Vectors and returns these to the procedure requesting input. A command 

45 vector is an ordered pair in which the first element specifies the vector type while the second element is a 
pointer, generally to a string. The vector type identifies the source of the input (e.g. keyboard, trackball, 
etc). Usually, the string pointed to by the second element will consist of the input received from the desk 
(FIGURE 7.13). The use of command vectors provides centralized error checking and a means for 
gracefully cancelling commands which prompt for input. A procedure which invokes "getdesk" will receive a 

so command vector when input has been received. It can simply check to vector type against the type it is 
expecting and cancel its operation if the type is incorrect. For example, if the user invokes a procedure 
which asks for several lines of keyboard input and he changes his mind halfway through its sequence of 
prompts, then he may simply touch the menu key for the operation he now wishes to perform. The software 
can see from the vector type that he has entered input other than it requires and can terminate its 

ss operation. The vector which was input may then be pushed back onto a command stack maintained by 
"getdesk" and will be the next command retrieved when input is again requested. One special type of 
vector exists in which the pointer element does not point to the input received from the desk. This special 
type is a Direct Command vector. Direct commands allow the user to invoke a menu key procedure by 
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typing the key label as it appears on the menu key. but preceded with a slash (/). In this case the pointer 
element points to an (x, y) coordinate pair which would be within the menu key for the corresponding 
command. This feature allows the use of the system even if the command monitor touch screen fails 
(FIGURE 7.14). 

5 

Control function processing 

Vector types corresponding to the shaft encoder and trackball inputs are classified as control function 
inputs and handled by as central control procedure. For control functions the input is a delta which indicates 

io the amount by which the position of the encoder or trackball was changed (for the trackball there are two 
deltas (dx, dy)). The deltas are received as strings of ASCII digits which are converted to their numeric 
equivalent. The vector type may then be used to send the delta to the appropriate procedure for 
processing. Control functions are used primarily to modify the state of the currently active image. In this 
case the input is used to adjust some parameter in the state vector for the image and then the processor is 

is cycled to redisplay the image in its new state. Of the six shaft encoders, four have permanently defined 
uses (window, level, filter and zoom) while the other two (f1 and f2) are interpreted differently by various 
procedures. For instance, when a sequence of 256 x 256 images is viewed as a movie loop these two 
functions control the speed and duration of the movie. When image shuffling is in effect, they each suffle 
images on the display, with f1 controlling display 1 and f2 controlling display 2. The use of six functions is 

20 arbitrary and not dictated by the architecture of the system, whether hardware or software. The trackball is 
also used for a variety of purposes, such as selecting images from the directory and panning images. Its 
use depends on the procedure for which it is providing input. 

Command dispatch . 

25 

The invocation of command procedures utilizes command vectors of two types; command monitor 
touch screen and direct command vectors. The former are most frequently used. Touch screen hits on the 
command monitor generate a coordinate pair. The active menu list is scanned top down until the first menu 
is found which encompasses the coordinates. The key descriptors of that menu are then searched until a 
30 key is found which contains the coordinates. The key descriptor contains a pointer to the function to be 
invoked (FIGURE 7.15). If the point does not fall within any menu, or if the point does not fall within a key in 
a menu, then the touch hit is ignored. Direct commands are invoked similarily, the difference being that the 
search is conducted by comparing key labels against the input string rather than checking coordinates. 

35 Image activation and movement . 

The transition of images from the inactive state to active is accomplished through menu commands. 
These commands allow the selection of an image from the directory of images available on disk. The 
selection of a new image for display also causes the currently active image, if any, to change to the ready 

40 stae. Activation of ready images is accomplished most directly using the touch screens on the image 
displays. When a touch screen hit occurs on one of the image displays a coordinate pair is generated. The 
image parameter blocks are searched, from top layer to lowest, until an image is found which contains the 
coordinate point. If point falls within the area of the currently active image a check is made to determine if 
image movement is enabled. If movement is enabled the point is taken to be the new center for the image 

45 and the display coordinates in the state vector (IPB) are adjusted and the image is redisplayed (FIGURE 
7.16). If movement is disabled the hit is ignored. Image movement is enabled and disabled by menu 
command, tf the touch hit falls within any other image on the display that image becomes the active image 
and the currently active image moves to the ready state. This feature allows the user to change the active 
image simply by touching the desired image. Coupled with the menu drive command input the user is 

so provided with a nearly typing free interface. 

Image shuffling . 

The touch activation of images is ineffective in the situation where an image is completely covered by 
55 one or more other images. In that case when the user touches the screen the touch hit is seen as selecting 
the upper layer image and he cannot bring the hidden image up. This problem is solved by providing the 
capability to "shuffle" images among the layers, from lowest to highest or vice versa. Shuffling is enabled 
by menu command and once enabled allows the f1 and f2 function inputs to select the active image on the 
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corresponding display (FIGURE 7.16). 

The following is a description of image processor control according to the invention, including the image 
processor driver (IPD), invocation of IPD, and synchronization. 

5 Image processor driver (IPD) . 

A distinct and independent procedure interacts with the control registers of the image processor. This 
procedure is a trap handler called the Image Processor Driver (IPD). The state vector of the currently active 
image (i.e. its IPB) is used by the IPD to configure the image processor control registers and initiate 
w processing. Configuration of the processor also includes loading the LUT and the filter coefficients. 

Invocation of IPD . 

The IPD is completely independent of the remainder of the user interface software. The IPD expects the 
j 5 state vectors to be at a specified location in memory, and to have a specified format. Likewise, the user 
interface procedures expect the IPD to receive control when a specific trap (TRAP 13) is executed by 
software. The image processor driver is the only software in the system which requires explicit knowledge 
of how to manipulate the image processor. It translates data structure representing an image state vector 
and manipulates the image processor to generate the correct image in the display memory. 

20 

Synchronization . 

The image processor is capable of generating a hardware interrupt to the system upon completion of 
processing. This provides the capability of initiating image processing and returning control to the user 
25 interface software, concurrent with image processing, to increase the efficiency of the system. The host cpu 
may resume executing instruction while the processor works, with the interrupt used for synchronization. As 
reduced to practice, the software is synchronous and the host cpu essentially idles during image 
processing. 

30 SOFTWARE EXTENSIONS 

The following extensions to the software system have been envisioned and could be readily imple- 
mented with the existing hardware resources of the system, as well as the current software. 

as Debugging utilities . 

A debugging utility is partly implemented in which a privileged user may examine major data structures 
within the system, such as the Image Location List and the Image Parameter Blocks. Additionally, the utility 
provides monitoring of resource usage by displaying disk and memory space information. The utility could 
40 be extended to include the capability of modifying those structures to facilitate testing or system debugging, 
or recovery of mistakenly deleted image data. 

Image processing in software . 

45 The image processing capabilities of the system may be expanded by software processing. The image 
information in the base memory is accessible to software, as are the display memory buffers. This allows 
software routines to process data from the base memory and write the processed image to the display. This 
processing could include algorithms which the processor hardware was not designed to perform, such as 
convolution operations, but would generally take longer to perform than processing done by the hardware. 

50 

User programming . 

A further extension of software image processing already envisioned, and partially implemented, would 
allow individual system users to write their own programs to run on the system. The current directory 
55 structure maintains a small amount of space to store user code. As reduced to practice the code must be 
developed on another computer and its executable form sent to the system through the network. This 
extension also requires a software interface through which the user's program may manipulate system data 
structures. 
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Region of interest and Density measures . 

The graphic overlay planes built into both the base memory and the display memories allow the 
software to be extended to during region of interest outlines, as well as other graphic applications. The 

5 image processor can produce histograms of specific areas of images which may be selected graphically 
since overlay bits may be used to enable/disable histogramming. Because both the base and display 
memories are accessible to the host cpu, density measurement may be made from either processed or 
unprocessed representation of an image. These measurement may be directed by the use of overlay 
graphics, for example an arbitrary curve may be drawn in the overlay and the underlying pixels plotted by 

jo grey level value. 

Image annovation . 

An additional use of the overlays in either memory would be to provide annotation of images with text 
is and markers. Combined with the ability to read image data from the display memories, annotation would 
allow the creating of processed, annotated images which may be sent to the archive for storage. This 
extension would be useful in teaching or the generation of annotated images for publication. A related 
capabiltiy is the display of reports (i.e. the written interpretation of the image). The current directory 
structure maintains space for such reports on disk. These reports would generally be received from the 
20 network, along with the image. 

Automatic image placement . 

A more sophisticated image placement algorithm is envisioned in which the software seeks to .optimize 
25 the placement of new images on the screen. This software would manage the blank areas on the display 
and attempt to fit new images into the optimal blank area, overlapping images only when necessary. The 
current software offers two methods of placing images: first, centered on the display; second, at the location 
the user specifies with a touch. 

30 Gallery mode display . 

A further possible feature of the user interface is Gallery mode display. In this mode all the images 
belonging to a specific patient could be displayed minified, somewhat like a contact print of 35 mm film. 
Images could then be selected for viewing at full resolution by touching the corresponding minified image in 
35 the gallery. Two possible methods of obtaining the gallery images exist. First, the gallery may be generated 
on the fly by using the continuous zoom capability of the image processor, processing each image for the 
patient sequentially. The second method places the burden of gallery generation on the archive system, 
expecting gallery sets to accompany any image data sent down from the archive for display. The 
comparative merits of these methods have not been examined. 

40 
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Appendix A 

The following components of an embodiment of the viewing 
station reduced to practice are well known devices and were used. 

1) . 1 Hitsubishi C6919LP Color monitor (512x512) 

2) . 1 Color Graphics controller VCME-512 

controller for 512x512 color monitor 
Graphic Strategies Inc. 

3) , 1 PKPD19 Resistive Film touch screen * controller 

Microtouch Systems Inc. 
400 W. Cuming Park 
Wbbum, HA 01801 

4) . 2 PX19V651LV80164 Black 6 White portrait node monitors 

(1024x1536) 
U.S. Pixel 

5) . 2 8000*3800-1 Infra-red touch sensors 

2 8000-0600-04 touch screen controllers 
Carroll Touch Technology Corp. 
2902 Parber Drive 
Champaign, IL 61821 

6) . 1 M2333 8-inch Winchester disk drive (340 Mbytes) 

Fujitsu America Inc* 

3075 Oakxnead Village Drive 

Santa Clara, CA 95051 

7) . 1 Sys68k/Cpu-1B single board computer 

Force Computers Inc./Ctabh 

Freishuetzstrasse 92 

d-8000 Nuenchen 81 Mast Germany 

8) . 1 SMVME 3100 256kb RAH memory board 

Slgnetlcs 

9) . Assorted power supplies (+5V, -5V, +15V, -15V, DC etc) 



Claims 

1. An image viewing station for picture archiving and communication systems, comprising: 

base memory means (10) for storing raw image data corresponding to plural images to be 
displayed; 

image processing means (12) coupted to said base memory means for performing predetermined 
processing operations on said raw image data and for providing corresponding display data, said image 
processing means including: 

zooming means (106) responsive to said stored raw image data for obtaining values of estimated 
image data along a line between said data; 

display memory means (14) coupled to said image processing means for storing the display data 
processed by said image data processing means; 

user input means (35) for generating input signals indicative of selected images and image formats 
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to be viewed; 

display means coupled to said display memory means for displaying images based on the display 
signals stored in said display memory means; and 

control processor means for connection through an internal bus to said base memory, image 
5 processor, and display memory means for providing the corresponding command signals responsive to 

said input signals from said user input means; 

characterised in that: 

said base memory means (10) stores raw image data produced by a plurality of modalities each 
with a different dynamic range; 
'0 said zoom means performs a fractional bilinear interpolation between the values of said raw image 

data so as to produce selectably continuous magnification or reduction of the image; and 

said image processing means further includes normalising means (102) for normalising said 
different dynamic ranges of said raw image data stored in said base memory means. 

75 Patentansprtiche 

1. Bildbetrachtungsstation fur Bildarchivierungs- und Kommunikationssysteme, mit : 

einer Basisspeichereinrichtung (10) zum Speichern von Rohbilddaten entsprechend mehrfacher 
anzuzeigender Bilder; 

?o einer Bildprozessoreinrichtung (12), die mit der Basisspeichereinrichtung gekoppelt ist, zum Durch- 

fuhren vorbestimmter Bearbeitungsoperationen an den Rohbilddaten und zum Bereitstellen entspre- 
chender Anzeigedaten, wobei die Bildprozessoreinrichtung enthalt: 

eine auf die gespeicherten Rohbilddaten ansprechende Zoom-Einrichtung (106) zum Erhalten von 
Werten geschatzter Bilddaten entlang einer Linie zwischen den Daten; 
25 einer mit der Bildprozessoreinrichtung gekoppelten Anzeigespeichereinrichtung (14) zum Speichern 

der von der Bilddatenprozessoreinrichtung bear beite ten Anzeigedaten; 

einer Benutzereingabeeinrichtung (35) zum Erzeugen ausgewahlte Bilder und zu betrachtende 
Bildformate anzeigender Eingabesignale; 

einer mit der Anzeigespeichereinrichtung gekoppelten Anzeigeeinrichtung zum Anzeigen von 
30 Bildern, die auf den in der Anzeigespeichereinrichtung gespeicherten Anzeigesignalen basieren; und 

einer Steuerungsprozessoreinrichtung zur Verbindung durch einen rnternen Bus mit dem Basisspei- 
cher, dem Bildprozessor und der Anzeigespeichereinrichtung zum Bereitstellen der entsprechenden auf 
die Eingabesignale von der Benutzereingabeeinrichtung reagierenden Befehlssignale; 

dadurch gekennzeichnet, dafi: 
35 die Basisspeichereinrichtung (10) Rohbildaten speichert, die durch eine Mehrzahl von AusfGhrungs- 

arten, jeweits mit einem verschiedenen dynamischen Bereich, erzeugt sind; 

die Zoom-Einrichtung eine fraktionale bilineare Interpolation zwischen den Werten der Rohbilddaten 
durchfuhrt, um so auswahlbar eine kontinuierliche Vergroflerung Oder Verkleinerung des Bildes zu 
erzeugen; und 

40 die Bildprozessoreinrichtung ferner eine Normalisierungseinrichtung (102) zum Normalisieren der 

verschiedenen dynamischen Bereiche der in der Basisspeichereinrichtung gespeicherten Rohbilddaten 
enthalt. 

Revendicatlons 

45 

1. Poste d'examen d'images pour systemes d'archivage et de communication d'images qui comprend : 

une m^moire de base (10) pour conserver des donn^es se rapportant a un certain nombre 
d'images devant etre presentees ou visualisees ; 

des moyens de traitement d'images (12) couples a ladite m^moire de base pour effectuer des 
so operations de traitement predeterminers sur lesdites donnees d'images brutes et pour produire des 
donnges d'affichage correspondantes, lesdits moyens de traitement incluant : 

des moyens de zoomage ou de variation de la distance focale (106) pour obtenir, en reponse 
auxdites donnees d'images brutes memorises, des valeurs de donnees d'images estimees le long 
d'une ligne ou d'une droite s'6tendant entre lesdites donnees; 
55 des moyens de m^moire d'affichage (14) couples auxdits moyens de traitement d'images pour 

conserver lesdites donnees aff tehees traitees par lesdits moyens de traitement de donnees d'images; 

des moyens d'entr^e d'usager (35) pour g^nerer des signaux d'entr^e d£signant des images 
selectionn^es et des formats d'images devant etre vus; 
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des moyens d'affichage couples auxdits moyens de memoire pour montrer ou pour presenter des 
images basees sur les signaux d'affichage conserves dans lesdits moyens de memorisation; et 

des moyens de processeur de commande aux fins de connexion, par un bus interne, a ladite 
memoire de base, un processeur d' images et des moyens pour produire les signaux de commande 
s correspondants en /dponse aux signaux d'entree provenant desdits moyens d'entree d'utilisateur. 

car acte rise en ce que ladite memoire de base (10) conserve des donnees d'images brutes 
produites selon un certain nombre avec, chacune, une plage dynamique diffe>ente; 

lesdits moyens de zoomage effectuant une interpolation bilineaire fractionnaire entre lesdites 
valeurs ou lesdites grandeurs desdites donnees d'images brutes de facon a produire un agrandisse- 
jo ment ou une reduction selectionnable continu de I'image; et 

lesdits moyens de traitement d'images comportant, en outre, des moyens (102) pour normaliser 
lesdites diffeVentes plages dynamiques des donnees d'images brutes conservees dans ladite memoire 
de base. 

is 
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E = A + XIB - A) (1) 
F=C + X(D-C) (2) 
0= E + Y IF- E) (3) 

SUBSTITUTE 11) AND 12) INTO 13): 

0= AfX(B-A)+Y{\C + X(0-C]\ - \A+X{B-A}}} 
= A +X(B~A)+ Y{C + XD -XC-A-XB + XAJ 
= A + XIB -A)t Y (C-A) + XY(D-C-B +A) 



Fig. J. J. 
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SYSTEM => USER 

— COMMAND MENUS 

— TEXT DISPLAY 

— IMAGE DISPLAY 

USER => SYSTEM 

- COMMAND INPUT 

- FUNCTION CONTROL INPUT 

- IMAGE TOUCH SCREEN IN 



Fig. 71 



EXTERNAL COMMUNICATIONS 
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IMAGE STATE TRANSITIONS 
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DIRECTORY CENTRAL TRACK STRUCTURE 



W OR D 
0 

1 



350 
351 
352 
353 
354- 
355 
356 
357 
358 

376 

m 

1951 
1971 

25U7 

mio 

19925 



VALID FLAG 'AA'=>VAUD 



I/O ERROR COUNT 



RESERVED 



BASE TRK * FOR SWAP TRKS 



ICL TRACK* 



POL TRACK* 



RPL TRACK* 



ICL BACKUP TRACK* 



PDL BACKUP TRACK* 



RPL BACKUP TRACK* 



AIBASE TRACK* 



20 REPORT TRACK* 'S 



REPORT CONTROL LIST 
20 VECTORS OF THE FORM: 
<1st FREE BYTE(W),* BYTES! W)> 



REPORT POINTERS 
511 VECTORS OF THE FORM: 
<INDEXES(W).OFFSET(W),LENGTHIW)> 



20 PROGRAM DIRECTORY TRACK* 'S 



PROGRAM DIRECTORY 
6U VECTORS OF THE FORM: 
csectors(12byfes), index(w), of setlw), sizefwh 



IMAGE LOCATION LIST 
511 TABLES OF 11 VECTORS OF THE FORM: 
<TRK*(W),BYTE(L)> 



ALLOCATION BITMAP 
1 BIT PER TRACKf 6230 TRKS) 



BAD TRACK BITMAP 
1BIT PER TRACK! 8230 TRKS) 



F/g.7.5. 



SIZE 
(BYTES) 

2 
2 



696 

2 
2 
2 
2 
2 
2 
2 
2 
UO 

80 

3066 
UO 
1152 

33726 

1030 
1030 

total Tom 



57 



EP 0 258 976 B1 



IMAGE LOCATION LIST 



IMAGE LOCATION 
VECTOR ELEMENT - n 



(AS IMPLEMENT) 



0 



1 



TRACK # (SHORT) 



BYTE COUNT (UNS LONG) 



IMAGE 
LOCATION 
' VECTOR 
0 




TO 



o f 















IMAGE 
LOCATION 
VECTOR 
1 




IMAGE 
LOCATION 
VECTOR 
STO 



IMAGE 
V LOCATION 
LIST 



TRACK # e {Xl( Xel)T)(0< =X< = 8230)} 
BYTE COUNT e{XI(XEl)T\(0<=X<=336UU2W0)) 



F/g. 7.6. 



fin 
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IMAGE PARAMETER BLOCK (IPB) 



IMAGE REFERENCE NUMBER 
IMAGE LAYER NUMBER 
USE COUNTER 
BASE MEMORY PIXELS/ LINE 
BASE MEMORY LINES/ IMAGE 
BASE MEMORY BITS/ PIXEL 
DISPLAY MEMORY PIXELS/ UNE 
DISPLAY MEMORY LINES /IMAGE 
DISPLAY MEMORY SELECT 
STATE FLAGS (32 BITS) 
CURRENT WINDOW VALUE 
CURRENT LEVEL VALUE 
CURRENT MAP TYPE 
BASE MEMORY STARTING ADDRESS 
BASE MEMORY PROCESSING X OFFSET 
BASE MEMORY PROCESSING Y OFFSET 
DISPLAY MEMORY UPPER LEFT CORNER X 
DISPLAY MEMORY UPPER LEFT CORNER Y 
DISPLAY MEMORY PROCESSED IMAGE X OFFSET 
DISPLAY MEMORY PROCESSED IMAGE Y OFFSET 
DISPLAY MEMORY PROCESSEO IMAGE PIXELS 
DISPLAY MEMORY PROCESSED IMAGE LINES 
BASE MEMORY CURSOR X 
BASE MEMORY CURSOR Y 
CURRENT FILTER TYPE 
CURRENT ZOOM FACTOR 
POINTER TO IPB FOR REFERENCE IMAGE 
POINTER TO IMAGE LOCATION VECTOR 
POL ENTRY 
ICL ENTRY 
RPL ENTRY 



Fig.79. 
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— : 80 Bytes 

NAME/PID/DOB/SEX DATA LIST 



Name string 


#0 


PID 


DOB 


SEX 


0 




Name string 


#5// 


PID 


DOB 


SEX 


0 



(PATIENT 

DATH 

LIST) 



Name -up to U chars -.PID -up to 21 ehars : DOB-10 chars; 
SEX-1 char chars for V delimiters; 1 for null}. 



IMAGE CTRL/STY TYP/DOS/TOS DATA LIST 



ImgJyp Ser.# Fras Lns Pxls Bits #7*s Ptr StyJyp DOS TOS 0 



(IMAGE 

CONTROL 

LIST) 



ImgJyp Ser_# Fras Lns Pxls Bits 4*V-ks Ptr StyJyp DOS TOS 0 



Img Typ-2 chars-,Series4¥ - U charsfras-U chars,Lin-U chars-, 
Pix-U chars,Bits-2 chars : #Trks-t chars ; Ptr-4 chars; 
Sty Typ-\jp to 22 chars : DOS-10 chars JOS-8 chars. 
(11 chars for' 'delimiters^ for null terminator). 



PHYSICIAN/RADDLOGIST DATA LIST 



Physician name#0 



Radiologist name # 0 



Physician name #511 Radiologist name# 511 



Physician -up to 39 chars,Radiologist-up to 39 chars ; 
(1 char for' 'delimiters J char for null terminator). 



(RADIOLOGIST/ 

PHYSICIAN 

LIST) 



FigJIO. 
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ADA PTIVE INTERFACE FILE 

SYSTEM 
USER ENTRY 

USERO 



USER 1 



USER 157 



reserved 
176 BYTES 



F/g.Z//. 



ADAPTIVE INTERFACE FILE USER RECORD 

user logon name 
user password 
control flag 

user record index 
img type 0- default window 
img type 0-default level 
img type 0- default filter 
img type 0-dsply 1 cursor 
img type 0-dsply 2 cursor 
img type 0- default zoom 

• 

img type 8-defaulf window 
img type 8- default level 
img type 8- default filter 
img type 8-dsply 1 cursor 
img type 8-dsply 2 cursor 
img type 8 -default zoom 
resersed(272 bytes) 

NOTE total record size is 256 bytes, 

F/g.Z/2. 
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DIGITAL RADIOLOGIC IMAGE WORKSTATION 
COMMAND PROCESSING 




TRANSPORT 
COORDINATE 



INVOKE 
MENU 
COMMAND 




TRANSPORT 
COORDINATE 



PROCESS 
CONTROL 
FUNCTION 
INPUT 



ACTIVATE 
IMAGE 



F/G.7J4. 
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TOUCHSCREEN ACTIVATION 
OF IMAGES 



TOUCHSCREEN HTT 




IMAGE 
•ACTIVATION 
REQUEST 



COMt 
NEW C 
FOR l 


WE 

ENTER 

'MAGE 






CtCUE IMAGE 

THROUGH 
PROCESSOR 



Fig. 7.16. 
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SHUFFLE ACTIVATION 
OF IMAGES 

IMAGE PARAMETER BLOCKS 
(IPB'S) 



REFNUM: 
LAYER: 



8 



ACTIVE 

4) 



IMG 1 



FREE 



DATA FLOW 
THOUGH PROCESSOR 




BASE MEMORY 



IMAGE 
PROCESSOR 



® 



DISPLAY MEMORY 



EACH IPB HAS A POINTER (7) TO IMAGE LOCATION IN BASE MEMORY 
AND A POINTER (?) TO IMAGE LOCATION IN DISPLAY MEMORY ONLY 
ONE IMAGE IS ACTIVE AT ONE TIME AND ONLY ITS ASSOCIATED 
IMAGE IS PROCESSED.Q) 

IPBS HAVE A LAYER NUMBER, WITH EACH IPB (HENCE IMAGE) AT A 
UNIQUE LAYER.THE ACTIVE IMAGE IS ALWAYS AT THE TOP LAYER© 

WHEN A SHUFFLE S PERFORMED THE LAYER NUMBERS OF EACH IPB 
ARE SHUFFLED, FORWARD OR BACKWARD. ACCORDING TO: 
FORWARD LAYER #/ = LAYER #/ * 1; 

F (LAYER #y > MAX LAYER &) 

LAYER #/ = MIN LAYER #; 
ELSE IF (LAYER #/ < MIN LAYER #) 
LAYER #j = MAX LAYER; 

BACKWARD LAYER #j = LAYER #; - 1; 

(SAME TEST AS ABOVE) 

F/g.7/7. 
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BASE MEMORY MANAGEMENT 
-FREE SPACE MAINTAINED AT HIGH END OF BASE MEMORY 

10 
I 

HI 



IMG A 


ERASE 
LINE C 

S 


IMG A 


COMPRESS 


IMG A 


IMG B 


IMG B 


IMG B 


IMGC 


FREE 


IMGD 


IMG D 








FREE 


FREE 


FREE 



IF NEW IMAGE IS LARGER THAN AVAILABLE FREE SPACE THEN 
IMAGES ARE "SWAPPED OUT" UNTIL ENOUGH SPACE IS FREE. 





SW> 
IMG A 




COMPRESS 




INSTALL 
NEW IMG 


IMG A 1 




FREE 




IMGB 2 








IMGB 2 






IMGB 2 






FREE 




FREE 




FREE 







NEWIMG\ 



-COMPRESSION 



IMGA 



FREE 



IMGB 



FREE 



USE COUNTER (IN IPB) IS 
INCREMENTED EACH TIME 
IMAGE IS ACTIVE 



f WRITE 
h^. 70 SWAP 





READ 
'BACK 
'AT NEW 
LOCATION 
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